This article describes an Elasticsearch-based system for long-term agent memory, dividing data into episodic, semantic, and procedural indices with tailored aging and update rules. It uses hybrid retrieval—BM25 plus dense vectors fused by RRF and refined with a cross-encoder reranker—alongside per-user DLS, supersession, decay, and an LLM-driven consolidation process to keep memory accurate and scalable.

• Splitting agent memory into episodic, semantic, and procedural indices (each with its own decay/update rules) avoids one-size-fits-all tradeoffs in write rate and aging logic.
• Hybrid retrieval (BM25 + Jina v5 embeddings fused via RRF, then reranked with a Jina v2 cross-encoder over 160 candidates) hit 0.89 recall@10 across 168 test queries.
• Contradictions are resolved via supersession with time-decay ranking rather than deletion, preserving an audit trail while surfacing current facts.
• Document-level security enforced per-user isolation with zero cross-tenant leaks, all within a single Elasticsearch cluster exposed as an MCP-compatible tool.

This Dev newsletter covers American Express’s cell-based payment system for high availability, a persistent agent memory layer on Elasticsearch, and a large-scale malware campaign on GitHub. It also highlights AI agent security roadmaps, GDPR consent fines, compiler reproducibility fixes, and new autonomous agent frameworks.

• A team built persistent agent memory by layering episodic/semantic/procedural Elasticsearch indices, hitting 0.89 recall with zero cross-tenant leaks
• Attackers flooded GitHub with 10,000 malicious repos hiding Trojans in ZIPs, constantly swapping readme links and commits to outpace detection
• Norway's DPA fined Elkjop €1.8 million for illegally forcing marketing consent as a condition of customer sign-up, a clear GDPR violation
• American Express uses a cell-based architecture where independent processing "cells" isolate failures so one crash doesn't cascade across the payments system